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Not only has the number ofscholarly journals worldwide increased substantially in 
recent years but also the number of articles published in them. However, closer 
examination reveals that the percentage of articles actually published has remained 
in the region of 25%. This implies that much of researchers ' time and energy has 
been wasted because of failure to have their research findings published. This has 
been occurring despite the availability of a surfeit ofpublications on the theme of 
‘How to write and publish a scientific article ’. Analysis of the process of article 
writing and publishing reveals that it consists of four phases: writing and submitting 
an article, processes followed by the editor, actual review process by the reviewers, 
and how authors deal with thefeedback. A literature survey shows that the last phase 
has not been discussed in the same detail as the other three. The authors contend 
that ifprospective authors gave greater attention to this phase and learnedfrom the 
findings outlined in this article, it would lead to an improvement in the quality of 
future submissions to a journal, of education in this particular case. 

‘We have read your manuscript with boundless delight. If we are to publish your 
paper, it would be impossible for us to publish any work of lower standard. And, as 
it is unthinkable that, in the next thousand years, we shall see its equal, we are, to our 
regret, compelled to return your divine composition, and to beg you a thousand times 
to overlook our short sight and timidity.’ 

Reputedly a rejection slip from a Chinese economics journal (Day, 1983:90). 

Introductory remarks 

The publication of scholarly articles has grown worldwide in the decade between 1995 and 
2005. According to available statistics, the number of articles in peer-reviewed journals has 
increased in this period from 564,645 in 1995 to 709,541 in 2005 (National Board of Science, 
USA, as quoted by Cummings, 2010). The number of scholarly journals has also increased: 
11,429 journals appear on the list of ISI accredited journals — up from 8,500 in 2002 (De la 
Rey, 2002). Despite the publication successes attained by scholars according to these figures, 
there is evidence of considerable failure. The ‘mortality’ rate as far as ISI accredited journals 
are concerned is around 90%. The rate in the case of South African SAPSE-accreditedjoumals 
is around 70%. This implies that if, say, the success rate were pitched at 25% (i.e. in real 
figures the 709,541 in 2005), more than two million article submissions would have failed the 
peer review process. 

The picture becomes even gloomier when taking into account that there is an abundance 
of publications on ‘Howto write and publish a scholarly article’ (Fradkov, 2003; Venter, 2001; 
ASSAf, 2009 for scholarly books). A simple computer search with descriptors: write, publish, 
scientific article, education, journals, 2006-2009, revealed the following (sec Table 1). 
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Table 1 Number of hits on Google and Google Scholar on writing scholarly articles 


Topic / Theme 

Google 

Google Scholar 

How to write and publish a scientific article 

28,100,000 

178,000 

How to write and publish a scientific article in education 

1,310,000 

130,000 

How to write and publish a scientific article in education 

173,000 

21,000 

2006- 2009 



How to write and publish a scientific article in education 

88,200 

8,530 

journals 2006-2009 




Despite the availability of all these manuals about writing scholarly articles, the mortality 
rate of manuscripts has remained high. The acceptance rate of submissions by the ISI- and 
IBSS-accredited South African Journal of Education (SAJE ) is a case in point: 2006: 25%; 
2007: 28%; 2008: 19%, and 2009: 16% (SAJE Annual Reports: 2006-2009). 

While this phenomenon can arguably be related to the fact that South African (and other) 
academics have in recent years had to cope with the influx of large numbers of students and 
hence have had less time for devoting themselves to research and publication, there is also the 
possibility that they have not yet mastered the ‘art’ and/or ‘science’ of writing a scholarly 
article (Van der Walt, 2001). This state of affairs prompted us to ask whether (a) we would not 
be able to understand the problem better by analysing reviewers’ reports submitted to a par¬ 
ticular journal, and (b) whether certain guidelines could not be developed that might lead to 
greater acceptance of manuscripts. 

In order to find answers to the conundrum as to why submissions to scholarly journals 
have failed at such a rate, we subjected reviewers’/referees’ reports to the South African 
Journal of Education to analysis. This journal was selected because of the availability of 
digitalised reviewers' reports for 2006 to 2009. Based on this analysis, we concluded that the 
failure of prospective authors to submit publishable scholarly manuscripts can be ascribed to 
mainly two factors. Firstly, many ofthe manuscripts are based on unsound underlying research, 
i.e. a research project that was in itself methodologically and/or otherwise replete with all sorts 
of shortcomings. Secondly, many of the manuscripts are rejected because of failing to present 
the findings ofthe researched s) coherently and convincingly, or to substantiate their assertions, 
claims and/or contentions. 

Our purpose in this paper is to provide evidence in support of the contention that manu¬ 
scripts fail on at least these two counts. The remainder of this paper is, therefore, structured as 
follows. We commence by outlining the research methodology and the conceptual-theoretical 
framework against which we performed the empirical investigation. This is followed by a 
report on our findings. We then discuss the findings, and follow with a number of recom¬ 
mendations and concluding remarks. 

Ethical considerations 

We received pennission from the editorial committee to analyse reviewers' reports and to re¬ 
port on our findings, on condition that neither the names of the reviewers nor those of the 
authors of manuscripts be divulged. 
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Research design and methodology 

We followed a mixed methods or multi-analysis design for purposes of naturalistic genera¬ 
lization (Onwegbuezie et al., 200 9:passim; 117; also refer Ivankova, Creswell & Clark, 2008: 
254 ff), i.e. rather than the researcher generalizing the findings, it is the reader who generalizes 
from his or her past experiences (Onwegbuezie et al., 2009:120). This is a form of ‘fuzzy 
generalization', in the sense that ‘something (that) happened in one place ... might also hap¬ 
pen elsewhere’ (Ekiz, 2006:73). 

In the sequential mixed analysis that we followed (Brannen, 2008:53; Onwegbuezie et al., 
2009:129), the first set of methods pertained to the development of the conceptual-theoretical 
framework as well as to the more qualitative part of the empirical work (see Data processing). 
Here we applied a heuristic or hermeneutic-interpretivist document, text and narrative analysis 
(Ashley & Orenstein, 2005:36-38) which enabled us to hermeneutically and interpretively ana¬ 
lyse the literature and documents, such as peer-review fonns, for the purpose of composing a 
conceptual-theoretical framework for the empirical work. Using the criteria contained in the 
the South African Journal of Education’s current editorial evaluation form as a springboard, 
we developed a conceptual-theoretical framework to provide us with a series of constructs with 
which we could approach the empirical work. 

For the quantitative empirical investigation (see Data processing) we made use of so- 
called quasi-statistics which, according to Onwuegbuzie et al. (2009:126), can enable one to 
assess the amount of evidence that bears on a particular conclusion or observation (e.g. the 
frequencies at which reviewers refer to shortcomings in a manuscript). Drawing on the work 
of Neuman (2000:145-146), we did the empirical analysis and found that it brought to light 17 
categories and/or constructs. 

Conceptual-theoretical framework 

The process of writing an article consists of four phases. In the input phase, the researcher 
prepares an article and submits it to the editor (Booth et al., 2003; Henning et al., 2002; Leedy 
& Ormrod, 2005:282 ff. Huff, 2009; McMillan & Schumacher, 2010:465 ff.) 

In the process phase, the editor and/or members of the editorial committee do a pre¬ 
liminary evaluation of the article to see whether it complies with editorial policy, and if it 
passes this examination, the article is sent for review to at least two or three independent 
reviewers. They evaluate the article according to the editorial board's guidelines for evaluation 
of articles (refer Pickar, 2007:17). 

In the feedback phase, the reviewers return their reports. Based on the reports of the 
(majority of the) reviewers as well as on his/her own assessment of the suitability and standard 
of an article, in terms of the criteria contained in the evaluation sheet, the editor decides on the 
acceptability of the manuscript. Some authors file unfavourable reports in a bottom drawer 
(Murray, 2005:194), never to return to them. Others study them and tiy to learn from mistakes 
and shortcomings. In cases where only minor corrections are advised, authors compile a change 
log in which they indicate where they have effected changes and where they did or could not 
follow the advice and requests of the editor. 

There is an abundance of publications on the first three phases, but there appears to be a 
paucity of literature on the fourth phase. Although in some cases authors discuss the aspect of 
dealing with reviewers’ reports, they tend to shy away from describing how to do a detailed 
analysis ofreviewers’ reports. Murray (2005:187-203) presents a few examples ofreports and 
provides guidelines to authors for learning from them (p. 197). Although she regards this phase 
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as a ‘critical step’ in writing a paper (p. 188), she does not offer a detailed description of how 
to deal with reviewers’ reports. Mullin (1999) does not refer to reviewers’ reports but confines 
himself to dealing with feedback from colleagues and peers. Klingner et al. (2005) make use 
of a few examples of reviewers' reports in their discussion of how to deal with such feedback. 
The same applies to Uchiyama et al., (1999). Lotter’s (2000) and Fradkov’s (2003) papers 
provide guidelines for reviewers for adjudging scientific articles but none for prospective 
authors. 

Pickar (2007) mentions that the actual value of peer review has been Tittle studied’ but 
that it is clear that it helps editors decide whether to accept or reject an article. In his opinion, 
peer review ‘has helped both editors and authors to improve the quality of manuscripts’. He 
does not enter into a detailed analysis of reviewers’ reports to show how dealing with them can 
lead to improvement in the quality of manuscripts. Also Day (1983:80-93) does not find it 
necessary to give an analysis of reviewers’ reports to show how authors can learn from them. 
He merely provides advice to authors based on his personal experience and wisdom. 

The above discussion of literature regarding the review process, although by no means 
exhaustive, reveals a tendency among experts towards discussing the review process with the 
aid of a few select extracts from actual reviewers’ reports. Since we could find no publication 
in which the author makes a detailed analysis of actual reviewers’ reports to a journal, with 
specific respect to articles, to show how authors could learn from them, we resorted to two 
alternatives. Firstly we used the current evaluation form of the South African Journal of Edu¬ 
cation as a starting point, a copy of which can be obtained at nsosaje@nwu.ac.za. This form 
requires a reviewer to respond to the quality of a submission in terms of the following 11 
criteria: 1. the importance, relevance or appeal of the submission to the academic community; 
2. originality and independence; 3. presentation and readability (language usage, accuracy of 
references and bibliography); 4. statement of problem, aim and objectives; 5. theoretical frame¬ 
work (literature review); 6. appropriateness of a number of aspects (research design, data 
collection and procedure, ethical guidelines, data analysis, data presentation and discussion, 
conclusion and recommendations); 7. the extent to which the line of argumentation is clear, 
cohesive and logical; 8. contribution to theory; 9. contribution to practice; and the form con¬ 
cludes with space for a reviewer’s recommendations whether it should be published or not, and 
for critical comments and suggestions for improvement. 

Secondly, we checked the relevance and validity of the criteria contained in the standard 
evaluation form of the SAJE against the contents of sections on methodology in textbooks that 
typically treat the dissemination of research results under headings such as Form for evaluating 
a ... research report (Borg, Gall & Gall, 1993:427 ff). Preparing to draft, drafting and revising 
(Booth, Colomb & Williams, 2003: 183 ff). The research report (Babbie & Mouton, 2004:563 
ff) and Preparing the research report (Leedy & Ormrod, 2005:282 ff), to mention only a few. 
This revealed that the standard evaluation form of the Journal did indeed cover the most salient 
points of article writing and effective dissemination of research results. Based on this finding, 
we then used the nine criteria contained in the SAJE peer review form as instrument for 
analysing the reviewers’ reports for the period 2006 to the end of2009, as discussed later. This 
exercise enabled us to expand the original nine closed items of the Journal’s review form to the 
17 items reflected in Table 4. This expansion was due to the fact that some of the sub¬ 
categories of the SAJE peer review form gained such prominence in the analysis of reviewers’ 
reports that they had to be reflected in separate cells in Table 4. 

A qualitative analysis of the reviewers’ critical comments and suggestions cast more light 
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on some of the problems that the reviews brought to light. 

The findings and guidelines that we report will hopefully fill the lacuna regarding how 
prospective authors can learn from reviewers’ reports. Our investigation is especially signi¬ 
ficant from a South African perspective. The results of the 2008 Changing Academic Pro¬ 
fession international survey put South Africa last in the line of 18 participating countries in 
terms of research productivity (Cummings, 2010). Since South African scholars are clearly 
lagging behind it is important to discover the reasons for this and to suggest guidelines for 
assuaging the situation. 

Empirical investigation: analysis of reviewers’ reports 

Aim of the empirical part of the investigation 

The purpose of the analysis was to discover precisely for which reasons manuscripts were 
deemed unacceptable for publication in the SAJE. 

Sampling 

The editorial committee of the SAJE made available all the reviewers’ reports of manuscripts 
for the years from 2006 to the end of 2009 that had initially failed but were published after 
revision. We chose the SAJE because of its prominence in the educational fraternity, not only 
in South Africa but also worldwide. This Journal is one of only a handful of South African 
publications that are both ISI and IBSS accredited. All the reports for the years in question 
were also available in electronic format. 

A total of 710 articles was submitted to the SAJE in the period in question. Of this 
number, 154 (21.6%) were published. Only seven (7) were published as originally submitted; 
147 were published after revision and, in some cases, reassessment by reviewers. A total of 674 
reviewers were enlisted for reviewing these articles. Of this number, 634 were attached to 16 
higher education institutions in South Africa. The rest were attached to 18 higher education 
institutions outside South Africa. 

Data processing 

As stated earlier under Research design and methodology, we first determined the main themes 
or topics covered by the reviewers in their reports through the use of coding. We followed the 
three-step coding procedure outlined by Neuman (2000:420-425), Henning et al. (2004:104- 
106), De Vos et al. (2005:334) and Ekiz (2006:72). In the process of constructing and evalu¬ 
ating the different categories of reviewers’ remarks, hermeneutic-constructivist strategies were 
applied, which included establishment of external as well as internal statistical validity (quan¬ 
titative data used in an interpretivist manner) (Onwuegbuzie et al., 2009 :passim). 

All the reports were independently as well as jointly analysed by three researchers. The 
salient failures of the reviews were organised into categories (themes or topics), and efforts 
were made to subsume these categories under broader headings so as to avoid reporting on a 
multitude of smaller factors. 

Findings 

Table 2 resembles the format of the review form of SAJE, with the following two exceptions: 
no data available for ethical aspects (refer criterion 6 of the review form); it also expands the 
‘appropriateness’ criterion (6) in the review form by teasing out four ‘appropriateness sub¬ 
criteria’, namely, appropriateness of data collection and procedure (item 7 of the Table), 
appropriateness of data analysis (item 8), appropriateness of data presentation and discussion 
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(item 9) and appropriateness of conclusions (item 10). (Table 4 also reflects these and other 
sub-categories.) The coding of the various aspects of reviewers’ reports is given in Table 2. 


Table 2 C losed section of reviewers' reports: Frequency distribution of ratings (percentages) 




Excellent 

Good 

Moderate 

Poor 

1 . 

Importance of article and appeal to readers 
of SAJE 

6 

42 

36 

16 

2. 

Original and independent research 

1 

28 

48 

23 

3. 

Presentation, style, clarity, readability 

2 

28 

48 

22 

4. 

Statement of problems/aims/objectives 

2 

23 

43 

32 

5. 

Theoretical basis/Theoretical frame/ 

Literature review 

1 

17 

45 

37 

6. 

Appropriateness of research plan and 
design 

0 

18 

43 

39 

7. 

Appropriateness of data collection and 
procedure 

1 

20 

48 

31 

8. 

Appropriateness of data analysis 

1 

14 

47 

38 

9. 

Appropriateness of data presentation/ 
discussion 

1 

10 

49 

40 

10. 

Appropriateness of conclusions/ 
recommendations 

0 

8 

46 

46 

11 . 

To what extent is the line of argumentation 
in the article clear, cohesive and logical? 

0 

8 

52 

40 

12. 

Contribution to theory 

0 

3 

42 

55 

13. 

Contribution to practice 

0 

10 

48 

42 


In order to facilitate rank-ordering, the above ratings were weighted: excellent ratings 
were multiplied by 2, good ratings were multiplied by 1, moderate ratings were given a value 
of zero, and poor ratings were multiplied by -1. The weighted ratings are given in Table 3. 

Table 3 C losed section of the reviewers’ reports: Weighted aggregate scores 

Score 


1. Importance of article and appeal to readers of SAJE 38 

2. Original and independent research 7 

3. Presentation, style, clarity, readability 10 

4. Statement of problems/aims/objectives -? 

5. Theoretical basis/Theoretical frame/Literature review -18 

6. Appropriateness of research plan and design -21 

7. Appropriateness of data collection and procedure -11 

8. Appropriateness of data analysis -23 

9. Appropriateness of data presentation/discussion -29 

10. Appropriateness of conclusions/recommendations -38 


11. To what extent is the line of argumentation in the article clear, cohesive and -32 

logical? 

12. Contribution to theory -52 

13. Contribution to practice -32 
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According to Tables 2 and 3, the most important reason for the rejection of manuscripts 
was their poor contribution to theory. The scores in bold typeface for items 4 to 13 in Table 
3 show which other factors led to rejection. 

In Table 4, the third and fourth columns reflect criticisms against particular aspects of the 
manuscripts. A total of 1,748 sub-category responses (third and fourth columns), subsumed 
under 17 broader categories (columns 1 and 2), emerged from the analysis of the closed section 
of the reviewers' reports. 

The qualitative investigation on the basis of open item 11 of the review fonn revealed that 
the prospective author of a scholarly article should have mastered the following two aspects 
of scholarly work. Firstly, s/he should already have become a competent researcher and should 
possess research findings that are deemed worthwhile for sharing with the academic commu¬ 
nity. One reviewer wrote, 

It is always useful to ask yourself this question: Am I submitting this paper because I want 
to get something published, or am I submitting this paper because I have some important 
knowledge to share with other educators ? If you have some import an t knowledge to share, 
you can structure the paper around questions such as: What is this important knowledge? 
How did I obtain it? Why do I believe that it is true? Why is it worth sharing? What are 
the implications of this knowledge for other educators? How could other educators use 
this knowledge? What do I have to do to convince other educators that this knowledge is 
useful ? 

The following comments were made with respect to the ubiquitous problem of inadequate 
underlying research, especially regarding originality: 'No new insights about analysis, practice 
or theory are provided by the review‘In my opinion this is not new research — it is a re- 
invention of the wheel’; 'Don’t people read educational legislation and policies as all the 
"research ” of this article is contained in these documents ?’; It is always useful to askyourself 
this question : If someone who is already knowledgeable in thisfield (e.g. technology education) 
reads my paper, what important thing will they learn? Unless a knowledgeable reader ... will 
learn something important from your paper, there is not much point having them read it'. 

Secondly, a prospective author of a scholarly article should have mastered the intricacies 
of article-writing. In their qualitative remarks, reviewers tended to concentrate on a variety of 
factors regarding this second aspect. Some focused more on technical aspects, some more on 
the line of argumentation, others more on content. From the many remarks about quality of 
articles, we selected the following as representative: ‘ The abstract looks sloppy’, one reviewer 
remarked. Another advised, 

Always make sure that your paper lives up to the expectations created by the title and the 
abstract. A simple test is this: show several colleagues the title of your paper and ask 
them to tell you what they woidd expect to find in the paper. If what they expect is not 
what you have written, reconsider the title or rewrite the paper. Do the same thing with 
the abstract'. 

With respect to the introduction to the article one said, ‘The introduction is weak’ , the 
topicality of the research is not explained, and/or the organization or structure of the article is 
not acceptable (‘it is very poorly organised and lacks both coherence and cohesion’). 
Regarding the use of language, one remarked: ‘The language is laboured and convoluted; the 
syntax needs to be clarified’; 'the author should get the services of an editor'. Interference by 
the first language results in 'direct and clumsy translations from the mother tongue’ , according 
to another. 
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Table 4 Open section of reviewers’ reports (n = 674) : Comments (coded) 


Crit. Category Freq. Sub-categories 


1 Theme 3 

2 Title 50 

3 Abstract 34 

4 Introduction 11 


5 Aim/ 65 

problem 


6 Conceptual 53 

clarification 

7 Hypothesis 3 

8 Literature 254 

study/ 
theoretical 
framework 


9 Methodology 263 


Article does not deal with education concerns; of too local concern; not relevant to SAJE readership; topic not justified 
Title incomprehensible/makes no sense/puzzling/clumsy/unclear; words in title unclear; title does not fit content of article; 
title too long; some words should not be part of title; recommend title change 

Abstract incomplete (needs to be complete synthesis of article); discrepancy between abstract and rest of article; no logical 
flow; abstract replica of introduction rather than synopsis of article; contains unnecessary aspects 

Introduction inadequate (needs to be a road-map at the beginning, in which sections and its central argument are clarified; 
introduction does not give background of study; does not reflect the rationale or need for the study; too long; rest of article 
does not flow from introduction 

Should be formulated more explicitly/clearly/be broken up into secondary, scientifically manageable problems; problem 
statement too short; needs to be unpacked in more detail; too broad; not sufficient to drive research; article contains no aim, 
objective; is meaningless and unclear; problem statement at variance with aim, introduction, title, text; inadequate, absent; 
no motivation of problem or rationale of study; value of research not discussed; aim should not be to prove something but 
rather to enquire; aims as formulated problematic; problem statement too narrow and raises question whether researcher was 
open to the unforeseen 

Key concepts not defined/clarified/sufficiently interrogated/unpacked/ casual use of terms without defining them; conceptual 
definitions problematic/ do not correspond to dictionary definitions/ too vague/broad/inaccurate; key concepts wrongly used 
No hypothesis; too many hypotheses; hypothesis unnecessary for this kind of research; no grounds (in literature or 
elsewhere) for hypothesis 

Context/background to the study/problem not explained; mistakes in theoretical framework/literature survey; theoretical 
framework/literature study inadequate/absent; part(s) of literature survey/theoretical framework irrelevant; in literature 
survey/theoretical framework; unsubstantiated, sweeping statements; suspected plagiarism; factual errors; primary sources 
not consulted, author relies too much on secondary sources; literature study confuses different issues/theories; literature 
survey based on old/outdated sources/data; literature survey relies on one/too few sources; literature survey: no critical 
stance, interrogation, own stance, integration and synthesis absent 

Methodology inadequately explained; method not adequately justified; methodology contains too many details; assumptions 
at the basis of the methodology problematic; reliability not accounted for/suspect; validity not accounted 
for/explained/suspect; author clearly not competent with the research method used; research method employed 
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Table 4 Continued 


Crit. Category Freq. Sub-categories 


inappropriate/not the best for the problem under investigation; mismatch between problem and empirical study; unclear how 
method relates to aim/problem of study; method described under the heading research method is not the method employed; 
under the heading methodology no method is explained 

10 Findings 124 Interpretations/analysis of data superficial/ not rigorous enough/ not thorough enough/absent; presence of speculations (author 

criticized for stating: “This could be...; Tables are not related to the topic; factual errors/flaws in the processing of 
data/presentation of findings; presentation of findings unclear/inadequate; more detailed presentations of findings needed; 
qualitative studies: Interviews: need direct quotes from interviewees; unwarranted interpretations; unclear/vague statements in 
the presentation of findings; (Some of) the reported findings have nothing to do with the topic; (Some of findings) discordant 
with the literature study 

11 Conclusions 129 Conclusions unwarranted from the data/findings presented; conclusion should contain the outcome of the research; conclusion 

meaningless — does not tell what is not already known; conclusion absent; conclusion too abrupt and short; conclusion 
meaningless/too vague; implications/recommendations for practice not spelled out/meaningless/not concrete enough; 
theoretical implications of the study not spelled out; Conclusions: more unpacking/discussion needed; conclusion dwells on 
aspects/issues other than that which empirical study deals with; conclusion at variance with introduction/stated aims/focus of 
the study; own insight absent/weak/ not well thought through; need to state extent to which the study has succeeded or failed 
in answering the research question; not all questions in problem statement answered; conclusion naive; un-nuanced 
statements; contains unscientific generalisations; recommendations ignore sensitive issues/unethical; conclusion does not link 
theory and practice; generalises beyond what the research warrants; author does not take findings beyond the specific 
case/limited sample/population; recommendations for further research absent; no recommendations; recommendations should 
be motivated; part(s) of conclusion irrelevant in terms of problem/aim of research; final summative statement of paper absent 

12 References 121 Details of some sources incomplete/absent/wrong; reference technique used in text and/or list of references by author differs 

from that prescribed by the journal; not all sources cited in text are included in list of references and vice versa; reference 
style/list lacks consistency; discrepancies between citations and reference list (spelling, dates, number of authors); page 
numbers absent; author needs to cite source of not generally known and accepted information/contestable/controversial 
statements; references give away identity of the author 
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Table 4 Continued 


Crit. Category Freq. Sub-categories 


13 Language 242 


14 Style 36 


15 Technical 37 

16 Article as a 319 

whole 


17 Criticism not 55 
directed at one 
specific 
component 


Vague statements; too long and cumbersome formulations/sentences; poor choice of words; use words with totally wrong; 
meaning, nomenclature wrong/outdated; confusing terminology/author conflates terms; consistency of terminology needed; 
unclear/incomprehensible words/sentences; emotional/bombastic language/harsh adjectives; unwarranted use of certain 
words; dangerous/controversial/problematic words/statements; sexist terms; disrespectful language/insulting statements; 
unscientific statements, e.g. political rabble-rousing; article needs language editing; vague statements/unsubstantiated 
statements 

Wrong use of bullets: do not use bullets where an argument is needed; style of writing not reader friendly, e.g. uses bullet or 
telegram style where narrative is desirable; unnecessary repetitions; write in first person when reporting qualitative research; 
meaning of figures unclear; inappropriate headings; the narrative does not flow 
Article needs technical editing; mistakes due to sloppy proof-reading 

Article too large in scope/too ambitious/too broad sweep; article should be broken into two separate articles; article is too 
long; article difficult to make sense of; article lacks focus/has no central theme; article is poorly organised/structurally 
wrong; article has no evolution, no logical flow, appears like a laundry list, article does not reach its stated aim; article lacks 
coherence/integration; article lacks synthesis; article lacks scholarly rigour/academic depth/critical integration/is clearly 
below SAJE standard; article lacks substance/is too broad and thin; article yields no new knowledge/meaningful contribution 
to the scholarly debate/ the article states the obvious; too many confounding variables/factors not controlled/taken account 
of; contextual background to the study inadequately explained/taken into account; an over-reduction of a very complex 
phenomenon; assumptions upon which article is based false/problematic; problem much broader than the actual content of 
the study; the study is dated; the limitations of the study are not spelled out/taken into account; the article assumes too much 
knowledge of the topic on the part of the reader ; article too specialised for the (general) SAJE readership; 
contradictions/inconsistencies in article; trustworthiness of the research suspect 

Flow in narrative/logic broken; sweeping statements , unsubstantiated; un-nuanced statements; unclear what is citation and 
what is authorial text; Logic: lack of evidence to substantiate statements; (contestable/controversial statements accepted as 
undisputed truth); article lacks a line of argument; logic faulty; logic unclear; gaps in logic/logical leap; unsubstantiated 
statements; argument flimsy and needs to be strengthened 
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Discussion of findings 

Researchers must keep in mind that the article itself is not the research project; it is a report 
of research that has been completed and of which the results are now being shared with other 
interested parties. Researchers should, therefore, resist the 'publish or perish culture’ until they 
reach a point where they have substantial findings that should be shared with the academic (in 
this case, the education) community. 

Having the data and the findings to share is only the first half of the publishing enterprise. 
A prospective author should also know and understand the intricacies of writing a publishable 
article. Prospective authors would, therefore, find it worthwhile to study comprehensive ‘reject’ 
reports. 

The qualitative study of the reviewers’ reports leaves one with the impression that papers 
presented to the SAJE in the period 2006-2009 have largely failed because of inept pre¬ 
sentation. In some cases, the despair of the reviewers was quite obvious; they felt the need for 
findings and recommendations to be disseminated, but they did not see their way clear to 
approving a manuscript. In one case, a reviewer remarked that s/he had seen better papers from 
Honours students than the one s/he had just reviewed. 

From the quantitative investigation, the bold typeface in Tables 2 and 3 shows where the 
main problems with manuscripts lie, according to the reviewers (as reflected in the closed 
section of their reports). Failure to state the problem and objectives of the underlying research, 
absence or inadequacy of a conceptual and theoretical framework, problems with the research 
design, with data collection and processing, with the discussion of findings, with the presenta¬ 
tion of recommendations, with the underlying logic of the argument, with the contribution to 
theory and practice seem to have been the most serious shortcomings. 

Table 4 tells the same story from another perspective. The reviewers appear to have 
experienced the least problems with authors’ selection of theme, with introductions to their 
papers, with their statement of hypotheses, and with the technical editing of manuscripts. The 
frequencies in bold typeface show where they found the manuscripts to have fallen short. Of 
concern here are problems with conceptual-theoretical frameworks and research method, since 
these are two aspects in which prospective academics (researchers) can be expected to be 
meticulously trained. The problem of language usage and editing is also a cause for concern. 
The problems in this respect can be ascribed to the fact that authors are expected to write in 
English, which in many cases is their second and even third language. 

Columns 3 and 4 of Table 4 embody a much sharper instrument. The bold typeface (20 
was arbitrarily taken as a cut-off point) in the third column shows exactly where the reviewers 
pinpointed the problems with respect to each of the facets of a manuscript. Of concern here is 
once again the absence or inadequacy of a conceptual-theoretical framework and problems with 
the method applied in the underlying research. The problems with the conceptual-theoretical 
framework and the method are compounded with the shortcomings mentioned in the last 
column. 

Recommendations 

Prospective authors should study a number of‘reject’ reports by competent reviewers. How 
such reports can be accessed is not clear, but a study of these would be invaluable for an in¬ 
experienced author. 

Prospective article writers should, furthermore, make a careful study of the data we have 
presented in Tables 2 to 4, especially the shortcomings highlighted with bold typeface. They 
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should in fact consider keeping Tables 2 to 4 on the desk next to their computer, and constantly 
refer to them when planning a research project, during its execution and when writing up the 
findings. Although special attention is required for the problems highlighted, attention should 
also be paid to all the aspects of article writing contained in these three tables. A comparison 
between the current review form of the SAJE and the criteria reflected in the three tables shows 
no other constructs, dimensions, or factors in connection with writing articles for the SAJE than 
those already contained in the review form. Put differently, Table 4, although containing 17 
categories as opposed to the nine (9) in the peer review form of the SAJE, does not contain any 
new constructs or criteria not already reflected in the peer review form; some of its categories 
reflect sub-categories or criteria in the peer review form. It is, therefore, recommended that 
prospective authors keep the criteria embodied in the review form in mind. 

Although the findings that we report here are specifically relevant to authors contem¬ 
plating submitting a manuscript to the SAJE, we would argue that following these guidelines 
would also enhance the standard of article writing for other journals. 

The findings of this investigation can also be construed as an indictment against many a 
faculty of education. Contraiy to what one would have expected from the training of educa¬ 
tionists, they do not appear to have been well prepared for the construction of a conceptual- 
theoretical framework or research methodology. Also they appear not to have been exposed 
to adequate training in how to present their findings in a scholarly paper. For this reason, it is 
recommended that designers of post-graduate training in education should take cognisance of 
the problems highlighted in this study. Faculties of education should also consider enlisting the 
services of more senior researchers to help their less experienced colleagues, not merely to file 
and/or ignore negative reviews, but to try to learn from them as much as they can. 

Finally, the categories enumerated in Table 4 can be useful for editors when designing a 
questionnaire to be completed by reviewers. 

Conclusion 

We began the article by stating our contention that the failure of prospective authors to submit 
publishable scholarly manuscripts can be ascribed to a variety of factors, most notably the 
failure to do sound research as well as the inability to report their findings to the academic 
community appropriately and effectively. This contention has been vindicated by the three sets 
of evidence we have presented. The conceptual-theoretical overview of the process of article 
writing firstly revealed that not sufficient attention is devoted to the final phase of the process, 
namely, dealing with the contents of reviewers’ reports. Secondly the quantitative investigation 
demonstrated that much can be learned from a careful study of the lengthy narratives occa¬ 
sionally returned by reviewers. Thirdly the qualitative analysis pinpointed the areas of article 
writing in which manuscripts submitted to the SAJE have so far fallen short. 
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